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Abstract 



A collection of open problems in Costas arrays is presented, classified into several categories, along with the 
^ ' context in which they arise. 

2^ 1 Introduction 

I—,' Costas arrays arc square arrays of dots/Is and blanks/Os, such that there exists exactly one dot per row and 
I column (that is, they are permutation arrays), and such that a) no four dots not lying on a straight line form a 
' parallelogram, b) no four dots lying on a straight line form two equidistant pairs, and c) no three dots lying on a 
• ' straight line are equidistant. They appeared for the first time in 1965 in the context of SONAR detection ([18], 
''pi ■ and later [!!)] as a journal publication), when J. P. Costas, disappointed by the poor performance of SONARs, used 
[ them to describe a novel frequency hopping pattern for SONAR systems with optimal auto-correlation properties 
^ • (namely auto-correlation sidelobes of height at most 1). At that stage their study was entirely empirical and 
application-oriented. In 1984, however, after the publication of the two main construction methods for Costas 
I I arrays by S. Golomb [■'38], still the only ones of general applicability available today, they ofhcially acquired their 
^ [ present name and they became an object of mathematical interest and study. 

• The present author, along with his collaborators, has published numerous journal publications over the past 
six years on several aspects of Costas arrays, namely their theory, their properties, their enumeration, and their 
■ applications, in which many questions about them were settled. However, many old questions, along with several 
new ones emerging in the course of the author's research, have remained open, defying all attempts to answer them. 



The most important and promising amongst those are collected in this work, in the hope that it will get researchers 
[ interested in Costas arrays and willing to contribute further with their efforts. 
I ■ Inevitably, the selection of the material and its presentation were influenced by the author's own preferences 
• • I and views. Although a conscientious effort towards impartiality was made, the broad ground rule was set that 
. ^ • this study is intended to be centered around Costas arrays themselves, as opposed to an object or application 
\ which Costas arrays are related to. Accordingly, the selection of the various open problems presented was based 
■ on their potential advancement of our knowledge of Costas arrays themselves, be it in the direction of their theory 
or their applications, rather than on the advancement of some research area (e.g. SONAR/RADAR systems or 
cryptography) through the introduction (or further application) of Costas arrays in it. 

An attempt has been made to group the problems presented into families, representing thematic units. Once 
more, it should be stressed that this grouping is, to some extent, subjective, as it will be seen that some problems 
would naturally fit in several groups: in such cases, the choice was based on the problem's main context and 
orientation. 

This is not the first time a compilation of open problems in Costas arrays is attempted. In 2006, Prof. S. Rickard 
presented a brief list to the IMA conference [79], while the present author published a review on Costas arrays [.33], 
cataloguing some open problems as well. In 2007, S. Golomb and G. Gong published another brief work on the 
status of Costas arrays [61]. None of these lists, however, is of length comparable to the current one. Furthermore, 
these works, published at least three years ago, do not cover the significant recent developments in the subject. 
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2 Why Costas arrays? Some motivation 



RADAR/SONAR systems detect the the distance and velocity of targets around them by periodically transmitting 
a waveform W and listening for reflections R. In an ideal noiseless environment, R is an exact copy of W, attenuated 
and shifted in frequency and time. The time delay indicates the distance of the target, while the frequency shift, 
through the Doppler effect, its velocity (assuming that the frequency content of W is narrowband enough for the 
Doppler effect, which is multiplicative, to be well approximated by a uniform additive shift for all frequencies). 

The simplest way to detect the time and frequency shifts is by applying a matched filter: R is cross-correlated 
with shifted versions of W for various time and frequency shifts, and the pair of shifts corresponding to the maximal 
cross-correlation are the true shifts sought: 



(st,sP = argmax|'(/'(st,s/)| , where ipist^sj) 



+00 



{FsjW)it ^ st)R{t)dt. 
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Here, St and s/ denote the time and frequency shifts, respectively, and the operator Fg^ maps W to the signal 
obtained by translating every positive frequency of W^s spectrum by s/ to the right and every negative frequency 
by s/ to the left (so that Fg^W remains real). 

This simple idea fails to work in practice, because all real media are incoherent: phase delay varies with 
frequency, hence waveforms tend to spread while traveling in the medium [19], so that, by the time R reaches the 
receiver, it may look so different from W that coherent processing becomes inappropriate. 

J. P. Costas's idea [f!J] was to discard the unreliable phase information, and carry out the cross-correlation 
based on the energy contents of W and R alone. Consider a waveform of the form: 



W{t) = Acos + 2TT{fo + ^fi)t) ,te 
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where k e [n], T is the time duration of the pulse, /o, /i are two predetermined frequencies, <f>k are phases suitably 
chosen so that the phase of W is continuous in t (^i = may be chosen), and a : [n] — > [n] is a bijection. This is a 
frequency hopping waveform whose instantaneous frequency is 



/(0 = /o + -/i, 
n 
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W is completely determined by a, given that /o, /i, and T are set. 

Costas's idea amounts effectively to placing an energy content detector before the matched filter, thus recon- 
structing a from W, and similarly for R: the signals fed to the matched filter can then each be abstracted as a 2D 
infinite sequence, representing the time-frequency plane. This sequence is full of Os/blanks (energy is not present), 
except for a, n x n square that corresponds to a permutation array (whose Is/dots denote that energy is present 
there). The filter overlays the two 2D sequences, shifts one with respect to the other by v rows vertically and u 
columns horizontally, and counts how many pairs of dots overlap: this is the value of the cross-correlation 4* at 
{u, v) (compare with Definition 2 below). In the absence of noise, R is an exact copy of W, only shifted in time and 
frequency, so the matched filter will have found the correct shift parameters when the cross-correlation becomes 
equal to n. 

When noise is present, however, some of i?'s dots may have shifted irregularly, gone altogether missing, or even 
new dots may have appeared: R will no longer be an exact copy of W, and the maximal cross-correlation will no 
longer be n. One will have no alternative than to design the filter to locate the maximal cross-correlation (whose 
value will no longer be known a priori) and return the shift parameters corresponding to it. This maximum may no 
longer be unique and/or one of the (former) sidelobes may have grown taller than the main lobe. Unfortunately, 
both cases result in spurious target detection. 

What should the form of a (or the corresponding array A) be in order to minimize the probability of spurious 
detections? In the absence of noise, the cross-correlation is just a shifted form of the autocorrelation of A, A needs 
to be chosen in such a way as to suppress the height of the autocorrelation sidelobes relatively to the main lobe of 
height n as much as possible: 

A = A* = argminmax^'^.^(u, w). 

A (",'") 

Choosing any pair of dots in A, there exists a shift (their distance vector) moving one on top of the other, so 
sidelobes of height 1 will exist no matter what. If, however, it is stipulated that distance vectors be unique, there 
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will be no sidclobe of height 2 or more. This, however, is precisely the Costas property (compare with Definition 1 
below)! Autocorrelation is known as auto- ambiguity in the SONAR/RADAR community, and waveforms with the 
Costas property are said to have ideal thumbtack auto- ambiguity [19, G4]. 

Why should the optimal A be a permutation array, as we assumed (summarily and without any further expla- 
nation) above? Would using twice the same frequency, or using two frequencies simultaneously, not improve the 
autocorrelation? Costas argued on basic engineering principles that indeed it would not [19]. 

Why, finally, is the full force of the Costas property needed (if indeed it is)? Would sidelobes of height 2 or 
more, but still much shorter than the main lobe, not be enough? Indeed they might not, but for a reason we have 
not mentioned so far: even if such a signal performed well under noise conditions, as discussed above, there is still 
the issue of multipath interference. In the real world R will most likely be the sum of attenuated and shifted noisy 
versions of W (by different attenuation and shift parameters) representing echoes from different reflection paths, 
which may add up constructively at the receiver: the taller the sidelobes of W are, the easier it is for them to add 
up to a significantly tall sidclobe in R. 

3 Basics on Costas arrays 

Throughout this work, [n] will stand for the set of the first n positive integers {l,...,n}, n g N, and obvious 
modifications will also be used, such as [n] — 1 = {0, 1, . . . , n — 1} etc. It will also be convenient to consider primes 
to be included in prime powers as a subset (unless explicitly excluded). 

3.1 Definition of the Costas property 

Simply put, a Costas array is a square arrangement of dots and blanks, such that there is exactly one dot per row 
and column, and such that all vectors between dots are distinct. 

Definition 1. Let / : [ri] — !■ [n] be a bijection. / is said to have the Costas property or the distinct differences 
property iff the collection of vectors {(« — j, f{i) — f{j)) ■ ^ < j < i < n}, called the distance vectors, are all distinct, 
or, equivalently, iff 



in which case / is called a Costas permutation. The corresponding Costas array Af is the square nx n array where 
the elements at {f{i),i), i G [n] arc equal to 1 (dots), while the remaining elements are equal to (blanks): 



In view of this correspondence, the terms "Costas arrays" and "Costas permutations" will be used interchangeably. 
n is rcferccd to as the order of the Costas permutation/array. 

The Costas property is invariant under rotations of the array by 90°, horizontal and vertical flips, and flips 
around the diagonals, hence a Costas array of order n > 2 gives birth to an equivalence class (EC) that contains 
either eight Costas arrays, or four if the array happens to be symmetric; in the latter case, we the EC is called 
symmetric. Note also that both the domain and the range of / can be translated, without affecting the definition 
of the Costas property: in particular, considering [n] — 1 instead of [n] for both the domain and the range proves 
occasionally to be a more suitable convention. 

Definition 2. Let f,g : [n] [n] where n £ N* , and let u, tj e Z. The cross-correlation between / and g at {u,v) 
is defined as 



Informally, the cross-correlation can be visualized in the following way: first, the two Costas arrays are placed 
on top of each other, and then the first is translated by v units vertically and u horizontally. The number of pairs 
of overlapping dots is the value of the cross-correlation ^ at {u,v). 

It should perhaps be stated explicitly that in all definitions above, addition stands for ordinary addition in Z, 
not modular addition. It should also be noted that Definition 1 can be rephrased in the following three equivalent 
ways as follows: a bijection / : [n] — !■ [n] is a Costas permutation iff 



Vi, j, k such that 1 < i,j, i + k,j + k < n : f{i + k) — f{i) = f{j + k) — f{j) ^ i = j or k = 0, 



(4) 




(5) 



*/,9(".«) - \{{fit) + v,i + u) -.ie [n]}n{ig{i),i):ie [n]}\. 



(6) 
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• the collection of vectors {(/(«) — f{j),i ~ j) '■ hj & > j} does not contain any duplications, namely iff 
all vectors therein, known as the distance vectors^ are distinct, which, geometrically, means that no two of 
them can have both the same length and the same slope; or 

• its auto-correlation range consists of exactly three values, namely {n, 1,0} (this is based on the description 
in Section 2). 

The first variant is equivalent, in turn, to the definition given in the Introduction: no four dots can form a 
parallelogram, or else a pair of equal distance vectors would exist, violating the Costas property (note that the 
cases of four dots lying on a straight line and equidistant in pairs, or of three equidistant dots on a straight line, 
are considered to be limit cases of a completely "flattened" parallelogram and are also forbidden by the definition). 

3.2 Construction algorithms 

There exist two two main algorithms for the construction of Costas arrays, based on the algebraic theory of finite 
fields. They arc known as the Golomb and Welch methods, and each actually comprising several submethods. They 
are stated below without proofs, but all details can be found in [33, 43, 58, 59, 64]. A further semi-empirical method 
relying on these two, known as the Rickard method, must also be mentioned alongside them, as it is currently the 
only additional method that has successfully led to the discovery of previously unknown Costas arrays (four so 
far, namely two of order 29, one of order 36, and one of order 42) [78]. They are all presented below, classified 
according to their applicability (this classification, also presented in [4.3], is compatible with and an improvement 
of the classification presented in [94]). 

3.2.1 Generated Costas arrays 

Definition 3. An infinite family of Costas arrays will be characterized as "generated" iff its members are con- 
structed by an algorithm whose applicability is determined by a sufficient condition involving only the order of the 
array. 

The following is an exhaustive list of the families of generated Costas arrays currently known: 

Theorem 1 (Exponential Welch construction Wi^^{p,a,c)). Let p be a prime, let a be a primitive root of the 
finite field ¥{p) of p elements, and let c e [p — 1] — 1 be a constant; then, the function f : [p — 1] ^ [p — 1] where 
f{i) = a'^~^^'^ mod p is a bijection with the Costas property. 

Note that the inverse of a W^'^^-pcrmutation, corresponding to the transpose of the corresponding Wi^^ array, 
is not expressible by this formula for different a and c, but rather by swapping i and /(«). This construction is 
known as the Logarithmic Welch construction The two constructions together form the Welch construction 

Wi. It can be shown that the two sets of Exponential and Logarithmic Welch arrays are disjoint for p > 5 [37]: in 
particular, Wi-arrays for p > 5 are never symmetric. As there are p— 1 ways to choose c and 4'{p— 1) ways to choose 
a {4> stands for Eulcr's function), there are 2(p — l)0(p — 1) VFi-arrays in total. The property that cyclic shifts of a 
W"^^'^^ permutation (or, cquivalently, of the columns of a W^^'^^ array) lead to a new W^''^'^ array is known as single 

periodicity. Furthermore, it can be directly verified that, if / is a W^^'^'' permutation, then f{i) + / + ^^-^ — ^ ~ p 

for all i e [^^] (or, equivalently, the right half of a W^^"^ array is the same as its left half, only flipped upside 
down); this is known as anti-reflective symmetry. 

Theorem 2 (Exponential Welch construction W2^^{p,a)). Let p be a prime, and let a be a primitive root of the 
flnite field F(p) of p elements; then, the corresponding Wi{p,a,Q) function g : [p — 1] — > [p — 1] satisfies g{l) = 1 
and, consequently, the function / : [p — 3] — > [p — 3] where f{i) = g{i + 1) — 1, i G [p — 2], is a bijection with the 
Costas property. 

Theorem 3 (Golomb construction G2{p,rn, a, P)). Let p be a prime, m G N, and let a, P be primitive roots of 
the finite field F(p™) oi q = p™ elements; then, the function / : [q — 2] — >■ [g — 2] where a^'^^^ -|- /3* = 1 is a bijection 
with the Costas property. 

For a given g, there are (/>^(g — 1)/to G2-arrays in total, and they are symmetric iff either a = /3, this special 
case being known as the Lempel construction [.3-!], or else whenever q = r^ and /3 ~ [-'A- 
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Theorem 4 (Golomb construction G3{p,'m, a, /3)). Let p be a prime, m G N, and let a, /? be primitive roots of 
the finite field ¥{p"') oi q = elements with the property that a + /3 = 1; then, the corresponding G2{p, m, a, (3) 
function g : [q — 2] ^ [q — 2] satisfies g{l) = 1, and, consequently, the function / : [g — 3] — >■ [g — 3] where 
f{i) = g{i + f ) — f , i G [q — 3], is a bijection with the Costas property. 

Theorem 5 (Golomb construction G4{m,a, (3)). Let m £ N, and let a, p be primitive roots of the finite field 
F(2™) of (jf = 2™ elements with the property that a + /? = 1; then, the corresponding 6*2(2, m, a, /3) function 
g : [q — 2] ^ [q — 2] satisfies .g(l) = 1, ,9(2) = 2, and, consequently, the function J : [q — 4\ ^ [q — 4\ where 
f{i) = g{i + 2) — 2, i e — 4], is a bijection with the Costas property. 

The inclusion of G3- and G4-constructions amongst the generated families is far from obvious, hrdeed, both 
rely on the existence of two primitive roots in a finite field summing up to 1, and this seems to be an applicability 
condition involving more parameters than the order of the finite field, in violation of Definition 3. It has been 
proved [20], however, that every finite field contains at least one pair of primitive roots summing up to 1, so this 
is, in fact, not an applicability condition. 

3.2.2 Emergent Costas arrays 

Definition 4. An infinite family of Costas arrays will be characterized as "predictably emergent" iff a) its members 
are constructed through a transformation of generated Costas arrays; b) the Costas property of the members of 
the family cannot be asserted by a condition involving the order of the array alone; and c) the Costas property 
of the members of the family can be asserted by a condition involving the order of the array and some additional 
parameters. 

Theorem 6 (Exponential Welch construction W^^^{p)). Let p be a prime such that 2 is a primitive element of 
the finite field ¥{p); then, the corresponding Wi{p,2,0) function g : [p — 1] ^ [p — 1] satisfies g{l) = 1, g{2) = 2, 
and, consequently, the function / : [p — 3] — > [p — 3] where f{i) = g{i + 2) — 2, i G [p — 3], is a bijection with the 
Costas property. 

Theorem 7 (Golomb construction Gl{p, m, a, /?)). Let p > 2 be a prime, m e N, and let a, (3 be primitive roots 
of the finite field F(p™) oi q = p™ elements with the properties that a + /3 = 1 and + = 1; then, the 
corresponding G2(p, m, a, f3) function g : [q — 2] ^ [q — 2] satisfies g{l) — 1, g{2) = q — 2, and, consequently, the 
function f : [q — A] ^ [q — 4] where f{i) ~ g{i + 2) — 1, i G [q — 4], is a bijection with the Costas property. 

Theorem 8 (Golomb construction G|*(p, to, a)). Let p > 2 be a prime, m G N, and let a be a primitive root of 
the finite field F(p™) of q = p™ elements with the property that a + — 1; then, the corresponding G2(p, to, a, a) 
function g : [q — 2] ^ [q— 2] satisfies g(l) = 2, g{2) = 1, and. consequently, the function f : [q — A] ^ [q — A] where 
f{i) = g{i + 2) — 2, i G [g — 4], is a bijection with the Costas property. 

This method is labeled as in [5!), ()4], but a different label is used here to improve uniformity. 

Theorem 9 (Golomb construction Gtj{p,m,a, (3)). Let p be a prime and to G N*, and let a, (3 be primitive 
elements of the finite field F(g) with the properties that a + /3 = 1 and + fi^^ — 1; then, it can be shown 
that these conditions always imply that + = 1 as well, whence the corresponding G2(p, to, a, /3) function 
g : [q—2] [q—2] satisfies 5(1) = 1, g[2) = q—2, and g{q— 2) = 2, and, consequently, the function / : [q—5] [q—5] 
where f(i) = g{i + 3) — 3, i G [g — 5], is a bijection with the Costas property. 

Regarding W!^^^ , it is not known for which primes p 2 is a primitive root, although necessary conditions for this 
to occur can easily be found (e.g. 2 should not be a square). It is not even known whether 2 is a primitive root for 
infinitely many primes p (this is a special case of Artin's Conjecture [<->7]). Sufficient conditions for the existence of 
primitive roots with the required properties for G|, G|*, and G5 are, similarly, unknown [59, 64]. 

Definition 5. An infinite family of Costas array will be characterized as "unpredictably emergent" iff a) its 
members are constructed through a transformation of generated Costas arrays; and b) the Costas property of the 
members of the family cannot be asserted by any condition other than direct verification. 

Heuristic 1 (Golomb construction Gi(p, m, a, /?)). Let p be a prime, to G N, a, /3 be primitive roots of the finite 
field F(p™) of (J = p™ elements, and let g : [q — 2] [q — 2] he the corresponding G2(p, m, a, (3). It may hold true 
that the function f : [q — 1] ^ [q — 1] such that /(I) = 1 and f{i) = g{i — 1) + 1, i G [g — 2] + 1, is a bijection with 
the Costas property. 
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This simply adds a corner dot to a G'2-Costas array. 

Heuristic 2 (Golomb construction Go{p, m, a, /?)). Let p be a prime, to € N, a, /3 be primitive roots of the finite 
field F(p™) oi q = elements, and let g : [g — 2] — > [q — 2] be the corresponding G2{p, to, a, It may hold true 
that the function / : [g] — >■ [g] such that /(I) = 1, f{q) = q, and f{i) = 3(1 — 1) + 1, i S [g — 2] + 1, is a bijection 
with the Costas property. 

This simply adds two anti-diametrical corner dots to a G2-Costas array. 

Heuristic 3 (Welch construction Wo{p, a, c)). Let p be a prime, a be a primitive root of the finite field F(p) of p 
elements, c G [p — 1] — 1 be a constant, and let g : [p — 1] ^ [p — 1] he the corresponding Wi{p, a, c). It may hold 
true that the function f : [p] [p] such that /(I) = 1, and f{i) = g{i — 1) + 1, « € [p — 1] + 1, is a bijection with 
the Costas property. 

This simply adds a corner dot to a Wi- Costas array. 

Heuristic 4 (Richard Welch construction RWq{p, a, c,t)). Let p be a prime, let a be a primitive root of the finite 
field ¥{p) of p elements, let c e [p — 1] — 1 and t G — 2] + 1 be constants, and let g : [p — 1] ^ [p — 1] he the 
corresponding W^^^{p,a,c) function. Consider the expansion g : [p — 1] — >■ [p], and the function gt : [p — 1] — ^ [p] 
where gt{i) = {g{i) + t — 1) mod p+\. Observe that t does not belong to the range of gt, so it may hold true that 
/ : [p] — > [p], where /(i) = gt{i), i G [p — 1], and fiji) = is a bijection with the Costas property. 

To understand better how this method works, start with a (p — 1) x (p — 1) array and add a blank row 

at the bottom, thus forming a p x (p — 1) array. By cyclically shifting the rows of this array t times, we obtain a 
new p X {p — 1) array where row t is now blank. By appending a column to the right, then, with a dot in row t we 
construct a new permutation array, which may have the Costas property. 

Heuristic 5 (Richard Golomb construction RGi{p, to, a, /3, ti, ^2))- Let p be a prime, to G N, let a, /? be primitive 
roots of the finite field F(p™) of g = elements, let ti,t2 G [g — 3] + 1 and let 5 : [g — 2] ^ [g — 2] be the 
corresponding G2(p, to, a, /3) function. Consider the function gti,t2 '■ [q ~ l]\{^i} ^ [q ^ 1]\{^2} where 5*1, tal*) = 
{g{{i - ti - 1) mod (g - 1) + 1) + ^2 - 1) mod (g - 1) + 1. It may hold true that / ; [g - 1] [g - 1], where 
f{i) ~ 3ti,t2(*)j * £ [9 ^ llM^ili ^-i^d f{ti) = ^2, is a bijection with the Costas property. 

This method can also be better understood in terms of operations on a Costas array. Start with a (g — 2) x (g — 2) 
G2 array and add a blank row at the bottom and a blank column to the right, thus forming a (g — 1) x (g — 1) array. 
By cyclically shifting the columns of this array ti times and the rows ^2 times, we obtain a new (g — 1) x (g — 1) 
array where column ti and row ^2 is now blank. By adding a dot at position (t2,^i), then, we construct a new 
permutation array, which may have the Costas property. 

Note that Rickard Costas arrays can naturally be considered to include Gi and Wq Costas arrays as special 
cases, although in Definitions 4 and 5 above we excluded the parameters that would lead to such an inclusion, in 
order to keep the available construction methods as disjoint as possible. 

3.2.3 Sporadic Costas arrays 

Definition 6. A Costas array will be characterized as "sporadic" iff it is neither generated nor emergent. 

Sporadic Costas arrays of order n exist for 6 < 71 < 27. A single sporadic Costas array of order 27 exists, the 
existence of which was first announced in [48] and was first noted by J.K. Beard. It is currently the largest sporadic 
Costas array known. It is not known whether Costas arrays of order n exist for all n g N, but, given the list of 
the methods above, it is clear that, unless sporadic Costas arrays exist in abundance, in particular at the orders 
where generated or emergent Costas arrays do not exist, this cannot happen. The smallest values of n for which 
no Costas array of order n is currently known are n ^ 32 and 33 [33]. 

3.3 Known Costas arrays 

The following families of Costas arrays are known at present: 

• All Costas arrays of orders n < 29 have been found through exhaustive search [G, 43, 44, 48, 80]. 
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Table 1: The number of Costas arrays per order 1 < n < 32: the numbers shown after the slash arc the numbers 
of symmetric Costas arrays (there are two symmetric Costas arrays per EC for orders n > 2); the > notation is 
used for orders not yet enumerated, to signify that there may be more arrays in addition to the ones known so far. 
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Table 2: A Costas permutation along with its difference triangle 



• Costas arrays generated by the algebraic construction techniques mentioned above are available for infinitely 
many orders. 

Table 1 shows the number of known Costas arrays per order n. Note the main "lobe" formed by orders 
1 < n < 26: the number of Costas arrays monotonically increases for 1 < n < 16 and monotonically decreases 
for 16 < n < 26. The majority of Costas arrays in the orders lying towards the interior of the lobe are sporadic 
Costas arrays: for example, only 16 out of the 10240 Costas arrays of order 19 are algebraically constructed (they 
are Wp-arrays, to be precise). The situation is reversed towards the edges of the lobe, where there are only two 
sporadic ECs for ri = 26 [M)] (the paper actually reports three sporadic ECs, but one of them turns out to be 
constructiblc by the Rickard method), while all Costas arrays of orders n < 5 are algebraically constructed. 

There are two major online sources of information for Costas arrays: 

• Dr. J.K. Beard has prepared a database of all Costas arrays of orders n < 500, which is freely available on 
his website [lUl]; 

• The webpage set up by Prof. Scott Rickard and his associates [100] contains not only most papers on Costas 
arrays published in the literature, but also a freely available Matlab toolbox on Costas arrays [!)4]. 



3.4 The difference triangle 

As mentioned in Section 3.1, a permutation / of order n has the Costas property iff all distance vectors {(/(«) — 
f{j),i — j) ■ i, J € > j} are distinct. In order to verify this property more easily, these vectors can be grouped 
together according to their second coordinate: within each such group, all first coordinate values must be distinct. 
In other words, setting i — j = k, the collection of distance vectors can be rewritten as T{f) = {tk{f), k G [n — 1]} 
where tk{f) — {f{i + k) — f{j) : j €E [n — fc]). T is said to be the difference triangle of / and its fcth row, because 
of the way can be stacked one below the other to form a triangular shape, as in Table 2. The Costas property 
then is equivalent to ascertaining that no tk contains duplicate entries (this is indeed the case in Table 2). 
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According to what has been stated so far, ^ 2 ) ^ (^s) 'comparisons of pairs of values in the difference 

are required to verify the Costas property. The entries of the triangle, however, exhibit strong correlation, and this 

n — I 

number can be drastically reduced: W. Chang proved in 1987 [ i '">] that ii tk, fc = 1, . . . , — - — do not contain 
any duplication, then the remaining are automatically duplication-free as well. A further improvement within 

71—1 

the first — z — was later proposed in 

4 Core problems in the theory of Costas arrays 
4.1 Existence of Costas arrays 

The first and foremost requirement for the well-posedncss of a mathematical problem is a proof that a solution 
to this problem exists (or else any search for a solution would be futile). Accordingly, a requirement for the 
mathematical study of Costas arrays is a result determining which orders they exist in and do not exist in. In 
particular, do Costas arrays exist in all orders? This question was asked for the first time by S. Golomb and H. 
Taylor in 1984 [(14] and remains open ever since: 

Problem 1. Determine the number C{n) of Costas arrays of order n G N*. In particular, is C(n) > for all 
71 > 0? If not, determine the set X ^ {neW : C{n) = 0}. 

A notable attempt to compute C(7i) is due to W. Correll Jr. [ ]. Let 7^(71) stand for the set of all permutations 
of order ri, let ^{n) be the set of all pairs (i, j), 1 < i < j < ri, let T(7i) ~ {((ii, ji), (12,^2)) € ^{n) x 'D{n) : 
31 - H = ]2 - i2), and let 1(71) = 2'^("). Finally, for any i e 1(71), let n) = {f e V{n) : V((ii, ji), (^2, J2)) e 
h /(ii) ^ = /(i2) — /(*2)}, which essentially represent "hyperplanes" in the space 7^ (71). Note that 



P(?i)\C(7i) = y T{i, n)^n\- C{n) = 

iel(n) 



U •^(*'") 

ieX(n) 



(7) 



but also that elements of 1(71) are related by inclusion: 

Vii, 12 e I{n), ii n 12 C ij C ii U 12, j = 1, 2. (8) 

Such a structure is known as a (finite) lattice and it allows one to express | Uigx(ri) -^(*5^)| in terms of the 
individual |J^(i,7i)| through the Mobius Inversion Formula which is simply a generalized version of the well 
known Inclusion- Exclusion Principle. Unfortunately, neither the exact lattice structure of ^(ti) nor the exact value 
of |J^(i,7i)| for an arbitrary i € ^(ti) are simple to compute, so this approach remains mainly of theoretical value. 

To simplify the problem somewhat, consider the question of whether C(n) > for a fixed but arbitrary 71. This 
is a decision problem, admitting only "yes" or "no" as an answer. Today, the only certain answers that can be 
given to this question are positive answers, which can be given only at those 71 where Costas arrays have been 
constructed or found through exhaustive enumeration. In particular, it cannot be positively said for any n > 1 that 
C(7i) = 0, although there exist plenty of n for which no Costas array is currently known, the smallest two being 
71 = 32 and 33 (see, for example, [33, 43, 64], and virtually any publication on Costas arrays). Arguing at a high 
level and in computer-scientific terms, computing the answer to this decision problem involves some computational 
complexity expressed in terms of ii. At present, this is extremely high, essentially 0{n\), as the only procedure 
known to yield a guaranteed answer is exhaustive search, whereby every permutation of order 71 is tested for the 
Costas property [43, 48]; though there are, of course, shortcuts, the computation remains of exponential complexity. 
Can one hope for better? Assuming a candidate for a Costas permutation of order ?i is provided by an oracle, the 
actual verification of the Costas property is very fast, involving 0{n^) comparisons [3, 92], namely of polynomial 
complexity. These two facts prove that this decision problem lies in NP [57]. Is this the best that can be hoped 
for? 

Problem 2. Let E{n) stand for the decision problem "Is C{n) > 0?". What is the computational complexity of 
E{n) expressed in terms of n? In particular, is E NP-complete? 
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4.2 Bound on the number of Costas arrays 



Existence of Costas arrays in all orders is equivalent to establishing a positive lower bound for C{n). Of considerable 
importance would also be an upper bound of C{n). Trivially, C(n) < n!, and, unfortunately, the best possible 
result published today [33] does not represent a considerable improvement, as it states that 

9^ = o(-\^C{n) = 0{{n~l)\). (9) 

(It should be noted that the proof of this result, due to D. Huw Davies, was presented in the present author's 
review paper on Costas arrays [33] and given a nonexisting citation in the literature due to a misunderstanding. It 
later transpired that D. Huw Davies's paper, which the present author was privately handed and consulted for his 
review [33], was, in fact, never published. The proof itself is an excellent instance of the probabilistic method [1].) 

Though this result is enough to establish that the set of Costas arrays of order n represents asymptotically a set 
of zero density within the set of all permutations of order n, namely that lim C(n)/n! — >■ 0, the rate of convergence 
to it gives is too slow compared to what is observed in practice, where C(n)/n\, n e [29] seems to decay to 
monotonically and at an exponential rate. Two notable efforts towards obtaining an improved bound should be 
mentioned, both relying on the concept of "degrees of freedom" . 

The first method [92] focuses on the entries of the difference triangle of a Costas permutation. After estimating 
the number of independent comparisons of pairs of entries in the difference triangle that need to be carried out in 
order to ascertain that a permutation has the Costas property, it estimates the probability of a repeated entry in 
some row of the difference triangle, and finally estimates the probability C{n)/n\ under the simplifying assumption 
that pairs of repeated entries occur independently. Simplifying slightly, the following formula was reached: 

^(l-—Y'^ C{n) « \/2^exp ( -k\ - n + (ti + 0.5) ln(7i)^ , (10) 
n\ \ n J \ 12 / 

using Stirling's approximation. K was selected in [92] after fitting the curve to the (then) known values of C(n), 
n S [17], and was found to be K w 1. Amazingly, this estimate for C{n) can easily be verified to remain valid 
throughout the entire main "lobe" of n € [26] (see Section 3.3). On the downside, though, not only is it not 
rigorous, but it also erroneously predicts that limC(ri) = 0. 

The second, due to the present author, is inspired by the first, and especially by the underlying principle of 
"degrees of freedom" it introduces, but it looks for them in a different context. More precisely, this concept is now 
defined [2.3] as the smallest k < n such that there exist ii < Z2 < . . . < ifc S [ri] with the property that, for any 
arbitrary collection of values fi, . . . , fk G [n], the set of functions {/ : [n] — > [n] : ,f{ij) ~ fj, j € [k]} contains at 
most one Costas permutation. Clearly, it follows that 

C{n) <{n-k + iy.^^< (11) 

n! [n ~ k)\ 

which, depending on the asymptotic behavior of fc = k(n), may prove the asymptotic decay of C{n)/n\ to at an 
exponential rate. Indeed, the present author conjectured in [2-!] that fc = 3 independent of n for all "large" n (more 
precisely, n > 24). 

In any case, three interesting problems have emerged: 

Problem 3. Determine the "degrees of freedom" of Costas arrays of order n, as defined in the second approach 
above. If possible, improve on this definition. 

Problem 4. Determine a bound for C{n) that reflects more closely the actual rate of decay of C{n)/n\ observed 
in practice. Furthermore, prove or disprove that C{n)/n\ converges to monotonically. 



4.3 Sporadic Costas arrays 

Virtually all published results on Costas arrays concern algebraically constructed Costas arrays. Almost nothing is 
known about sporadic Costas arrays, a fact reflecting the inability to deduce properties of Costas arrays based on 
the definition alone. The enumeration of orders 28 and 29 revealed no sporadic Costas arrays there, and these are 
the first orders larger than order 5 where this occurs [43, 44]. There is, then, the possibility that sporadic Costas 
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arrays cease to exist from a certain order onwards. If so, the situation would be reminiscent of the classification 
of finite simple groups, which were found to consist of finitely many infinite families plus a finite number of some 
sporadic groups [95]. There is also the possibility that they constitute examples of generally applicable but still 
unknown construction techniques. 

Problem 5. Settle the status of sporadic Costas arrays: arc they finitely many? Are there new generally applicable 
construction techniques that produce them? 

A curious phenomenon associated with sporadic Costas arrays is the existence of twin Costas arrays: 

Definition 7. Let / : [n] — > [n] be a Costas permutation, and let gi , 52 : [n] — > [n] be defined through the relations 
9jii) = - 1) + 1, i = 2, . . . ,n + 1, j 1, 2, (7i(l) = g2{n + 2) = 1, and 32(1) = + 2) = n + 2. If 31,52 are 
also Costas permutations, they will be called twin Costas permutations. 

The only known example of twin Costas arrays, as is directly verifiable over the database, is generated out of a 
sporadic Costas array of order n — 21. 

Problem 6. Settle the status of twin Costas arrays: is the only known example the only one in existence? 
Otherwise, are there finitely /infinitely many pairs of twin Costas arrays? Can they be systematically constructed? 

Another result related to sporadic Costas arrays is yet another question first asked by S. Golomb and H. Taylor 
in 1984 [G4]: are there Costas arrays representing configuration of non-attacking queens on the (generalized n x n) 
chessboard? This question still remains open for n > 1. However, it is now known [■39] that, if such a Costas 
permutation exists, then it has to be sporadic. It is also known [25] that such a configuration is constructible on 
an infinite array. Refining the original question, then, 

Problem 7. Do (sporadic) Costas arrays of finite order n > 1 exist, which also represent configurations of non- 
attacking queens on an n x n chessboard? If yes, how many are they, and can they be systematically constructed? 

There can only be finitely many such arrays: this follows from a surprising connection with honeycomb arrays 
[8] (more about this in Section 8.2). 

The final question about sporadic Costas arrays is one for which data is very limited. It has been shown [40] 
that G2 permutations contain G2 sub-permutations, in the following sense: 

Definition 8. Let / : [n] — > [n] be a permutation. If ai,a2 <E N and 61,62,' G N* exist such that the sets 
Sj = {aj + bji : i G [I]}, j ~ 1,2 are both subsets of [n] and satisfy f{Si) = ^2, then g : [/] — > [/], g{i) = 
{.f{o-i + bii) — 02) /b2 is said to be a sub-permutation of /. 

Problem 8. Is it true that for any Costas permutation g there exists a Costas permutation / such that 5 is a 
sub-pcrmutation of /? Is this true, in particular, for specific families of Costas permutations (e.g. sporadic)? 

4.4 Cycle structure of Costas permutations 

The iterative composition of G2 permutations has some interesting properties: for example [23], in any extension 
field whose size is a power of a prime number whose exponent contains an odd factor, Lempel G2 permutations are 
obtainable through the iterative composition of other G2 permutations! This suggests a closer study of the cycles 
of Costas permutations. Indeed, cycles have normally been part of any classical study of families of permutations, 
but have not been studied thoroughly in the context of Costas permutations. 

Definition 9. Let / : [n] — > [n] be a permutation, and let / : [n] — [n] be the identity: I{i) = i. Let Z*^") = /, 
and, for any fc e N, let = /(Z^'^)), in the sense that, for any i G [n], f^'^+^'^ii) = fU^^\i)). The cycle of i 

under / is the set {f'^^^i) '■ k G N}, which is necessarily finite, containing at most n elements. 

As an example, let us determine the cycles of the Wi permutation / — [1,2,4,8,5,10,9,7,3,6]: clearly 
f{i) ~ i for i — 1,2,5, so each of these three points forms its own cycle with a single element. Further, 
/(3) = 4,/(4) = 8,/(8) = 7,/(7) = 9, /(9) = 3, and /(6) = 10, /(lO) = 6, leading to the cycles (3,4,8,7,9) 
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and (6, 10). Consequently, we can write / = (1)(2)(5)(3, 4, 8, 7, 9)(6, 10) to show the cycle structure of / explicitly. 
Note that the order in which the cycles appear is immaterial; furthermore, the elements within a cycle can be 
cyclically shifted at will. 

Consider now f^^\ Given the cycle notation of /, it is easy to determine it values: for any i, we simply locate 
its cycle, and the value f^'^\i) will be the element of the cycle lying two positions to the right of z, for example 
/(^)(7) = 3. More generally, for any k, the value f^''\i) will be the element of the cycle lying k positions to the 
right of i. It follows that /'^'^^ = / iff fc is a multiple of the least common multiple of the cycle lengths of /, which, 
in this case, is 2 • 5 = 10. 

Problem 9. Describe the cycle structure of Costas permutations. In particular, 

• Determine the cycle structure of a particular Costas permutation; 

• Determine the existence/absence of cycles of a particular length in a specific Costas permutation, or a family 
thereof; 

• Determine the longest cycle in a specific Costas permutation, or a family thereof; 

• Determine the smallest k for which f''^^ ~ I for a specific Costas permutation /, or a family thereof. 

5 Problems related to the algebraic construction techniques 

5.1 Disjointness of the algebraic construction techniques 

The large number of algebraic constructions available for Costas arrays begs the question whether they all are 
genuinely distinct: can one rely on the fact that the sets of Costas arrays produced by each method do not overlap, 
at least for large enough orders? Or is it possible, for example, for a Costas array to be simultaneously Wi and Gi , 
for some i G [4] — 1, or even, assuming p and p + 2 are twin primes, to be simultaneously Wi{p) and G^{p + 2)1 
Such questions were addressed in [38], where a comparison between all possible pairs of methods was attempted: 
most pairs were shown to be incompatible, at least for large enough orders, but for some pairs it was not possible 
to reach a conclusion. 

Analysis of the Costas arrays database suggests that all methods discussed in Section 3.2 produce distinct 
Costas arrays for orders n > 5. Hence, the question remains: 

Problem 10. Are the construction methods discussed in Section 3.2 pairwise disjoint for orders n > 5? 

5.2 Scope of "dot addition" methods 

All unpredictably emergent construction techniques described in Section 3.2 rely on the addition of a new dot 
(usually, but not always, a corner dot) to and already existing Costas array. In "low" orders, these methods 
have scored some major successes: for example, the only two known Costas arrays ECs of order 19 prior to their 
enumeration, and the only one of order 31, are Wq arrays. Moreover, the Rickard construction techniques yielded 
two new i?Wo ECs of order 29, and one new RGi EC in orders 36 and 42, respectively [7S]. 

In higher orders, however, the story is quite different: the Rickard constructions fail to yield any further new 
Costas arrays up to order 100 [78], and the present author verified that this is the case up to order 300. Moreover, in 
the same search Gi and Wq arrays were also considered, and none were found above orders 52 and 53, respectively 
(the discovery of the latter was published in [!Hi]). 

Problem 11. Determine the scope of the unpredictably emergent construction techniques discussed in Section 3.2. 
In particular, is it the case that, for each method amongst them, a iV G N can be found, such that this method 
produces no Costas arrays of order n > N? 

5.3 Alternative construction techniques 

Considerable effort has been expended towards the discovery of construction techniques for Costas arrays. This 
area is undoubtedly dominated by the algebraic construction techniques discussed in Section 3.2, and the difficulty 
associated with discovering new constructions can perhaps be appreciated by the fact that several other proposed 
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techniques either fail to work or are equivalent to the existing ones. For example, J.K. Beard's spin-add technique 
[5] or polynomial generators [4] are equivalent to the unpredictably emergent methods, while Popovic's construction 
[76] is, in fact, a rediscovery of the Logarithmic Welch Costas arrays. 

An unfortunate side-effect of the long and honored academic tradition of publishing successful research is that 
researchers are doomed to try out unsuccessful ideas time and again. It is safe to say that it is not possible to 
know the full range of candidates for Costas arrays generation methods that have been tested and failed, though a 
published record of them would be invaluable, as it would permit researchers not to repeat mistakes of the past. 



For example, let us consider the simple idea of "interlacing" two Costas arrays: 
Definition 10. Let = [ajA be an n x n array, and let = [of A be either an n x n or an be an (n — 1) x {n— 1) 



array. Let A 



be the array defined by 



tt i+i j+i , i mod 2 = j mod 2 = 1; 

a\ j_, i mod 2 = j mod 2 = 0; 

2 ' 2 

0, otherwise. 



A is said to result from interlacing Ai and A2. 

Unfortunately, interlacing Costas arrays fails to produce a new Costas array as long as the order of either array 
is 3 or above: the case of equisized Ai and A2 was treated already in 1985 [55], while the case of sizes differing by 
1 was treated in [49]. The idea is that when size is large enough, both arrays contain a common distance vector. 
As interlacing rescales distance vectors by a factor of 2 without distorting the arrays, a parallelogram is formed. 



An even simpler obvious candidate for a construction technique is concatenation: given Ai and A2 Costas 
arrays, is 



a Costas array? Unfortunately, the argument used in [49, 55] is no longer applicable here, since Ai and A2 may be 
of arbitrary sizes. A stronger result would be needed, namely that any two "large enough" Costas arrays have a 
common distance vector. This seems likely to be the case, but no rigorous proof exists today. 

Note that, assuming (without loss of generality) that Ai is no larger than A2, concatenation works for infinitely 
many orders if Ai is 1 x 1 or 2 x 2 (examples are Wi arrays with c = and G2 arrays with a + /3 = 1, especially in 
fields of characteristic 2). However, the largest concatenated array in the database for which Ai is 3 x 3 is a 7 x 7 
Costas array. 

Problem 12. Is it the case that any two "large enough" Costas arrays have a distance vector in common? It may 
suffice that the smallest of the two be at least 3x3 and the largest at least 5x5. 

Note that this question was studied in [■)!i], but only for algebraically constructed Costas arrays. 

Having considered a method that fails to deliver, and a method that most likely fails to deliver, let us end 
with a completely different approach that still looks promising, namely a stochastic search for Costas arrays using 
genetic algorithms. The underlying idea is to start with a random permutation and, through a sequence of (possibly 
random) mutations, eventually reach a Costas permutation. 

A simple way to implement this search is through a "gradient descent" approach: after defining a metric/weight 
to measure how much a permutation deviates from the Costas property, a mutation is applied on it (from within 
a pre-specified set of permissible mutations) so as to decrease this metric (ideally, as much as possible). If this 
can happen under many different mutations, one is applied at random. If no mutation can achieve this, a random 
mutation is applied, or the procedure restarts with a new random permutation. The procedure runs until a Costas 
permutation is reached. 

A simple such metric is the total sum of the number of repeated entries within each row of the difference triangle 
of the permutation: for example, if a row contains three equal entries, this contributes two repetitions to the sum. 
Permissible mutations can be all possible rearrangements of the values of the permutation so that at least a certain 
pre-specified number of values do not get reassigned: for example, assuming the order is n, demanding that at 
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least n ~ 2 values do not get reassigned is equivalent to considering all pairwise swaps; demanding that at least 
n — 3 values do not get reassigned is equivalent to considering all 3-tuple swaps (which includes pairwise swaps as 
a subset); and so on. Alternatively, each recorded repetition in the difference triangle can be associated with the 
three or four values of the permutation giving rise to it, and then the values showing the most such "hits" can be 
deranged amongst themselves. 

Stochastic searches were considered in [42, 34, 84, 81], in which several different algorithms were tested. The 
general conclusion was that, although they performed adequately for "low" orders, they consistently failed to 
recover any Costas arrays in "higher" orders within a reasonable time interval (more specifically, in orders above 
15, allowing for a runtime up to 1 hour). As is the case with all genetic algorithms, success is heavily dependent 
upon the selection of a suitable metric and set of permissible mutations. 

Problem 13. Develop a stochastic search method for Costas arrays which works in large enough orders of interest 
(in particular, in orders 30, 31, 32, and 33). 

6 Inverse problems 

Most publications discussing properties of Costas arrays prove statements of the form: "If a Costas array is in 
family F, then it has property P" . For example, a T4 array represents a configuration of non-attacking kings on a 
chessboard [39]; a Wi array is singly periodic; a Wi array has anti-refiective symmetry [13]; the special subfamily 
of symmetric G2 permutations of order — 2 discussed in [-w] have r fixed points; and so on. There are very few 
statements, if any, of the form: "If a Costas array has property P, then it must be a member of family P." These 
problems will be referred to as inverse problems, and they have proved extremely difficult to treat so far. 

6.1 Single periodicity 

A quick search in the database identifies sporadic arrays possessing anti-reflective symmetry, so this property does 
not characterize Wi arrays. However, no singly periodic Costas array other than Wi arrays is known; it is only 
known that a Costas array of odd order cannot be singly periodic [(i4]. Quoting then a problem out of [()4] once 
more: 

Problem 14. Is it true that every singly periodic Costas array is a Wi array? 

A significant step towards the solution of this problem was taken in [()•'>], where the concept of a circular Costas 
array was introduced: 

Definition 11. A permutation / : [rt] — 1 — >■ [71] — 1 is said to be circular Costas, for all k G [71 — 1], all vectors 
f{i + k) — f{i), i G [n] — 1 are distinct mod(n -I- 1), when i + k is considered modn. 

Clearly, every Wi permutation is circular Costas, but the converse may not be true. It was shown in [ii,,] that, 
if a circular Costas permutation of order n exists, then n + 1 must be a prime. 

6.2 Cyclic shifts when blank columns/rows are added 

It was mentioned earlier, in Section 3.2 and in connection with the Rickard construction [78], that arrays 
have the property that, if a blank row is added at the top and then rows are cyclically shifted, the resulting array, 
which is no longer square, still has the Costas property; and similarly, that G2 arrays have the property that, if 
a blank row and a blank column are added at the top and at the side, and then rows and columns are cyclically 
shifted, the resulting array, which is square but no longer represents a permutation, still has the Costas property. 
These properties arc direct consequences of the definitions. Are, however, the converse statements true? 

Problem 15. Let a Costas array have the property that, if a blank row is added at the top, then any cyclic shift of 
the rows leads to a (non-square) array with the Costas property. Is such a Costas array necessarily a W^^"^ array? 

Problem 16. Let a Costas array have the property that, if a blank row and a blank column is added at the top 
and at the side, respectively, then any cyclic shift of the rows and columns leads to a (square but non-permutation) 
array with the Costas property. Is such a Costas array necessarily a G2 array? 
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7 Problems related to properties of Costas arrays 



7.1 Parity populations of G2 arrays in characteristic 2 

It was mentioned in Section 5.3 that interlacing two Costas arrays cannot lead to a new Costas array, as long as 
the order of either array is 3 or above. An interlaced array is considerably constrained, as its dots can only lie in 
positions whose coordinates are both even or both odd (this is a direct consequence of the definition). How close 
do algebraically constructed Costas arrays get to this state? Let ee, eo, oe, and 00 stand for the number of dots 
of the Costas array whose coordinates are both even, even and odd, odd and even, and both odd, respectively: it 
was found in [40] that, for G2 and Wi arrays, these four quantities, called the parity populations, were not only 
as equal as they could be (with the significant exception of Wi arrays constructed in F(p), p = 3 mod 4, where 
they were found to depend on the class number), but they were also independent of the primitive root(s) used. 
The latter was no longer the case, however, for G2 arrays constructed in fields of characteristic 2, where the parity 
populations varied across the various G2 arrays in the family. 

Problem 17. Determine the parity populations of G2 arrays constructed in fields of characteristic 2. 
Some numerical results relevant to this problem can be found in [32]. 

7.2 Fixed points 

It was mentioned in Section 6 that a special subfamily of symmetric G2 permutations of order q — 2, q a square 
prime power, have asymptotically y/g dots on their main diagonal. This is an interesting result, as diagonals of 
Costas arrays are Golomb rulers [30], and it is conjectured that the largest number of dots a Golomb ruler of a 
given length can contain is asymptotically equal to the square root of its length [30] : consequently, this subfamily is 
asymptotically optimally dense. Unfortunately, this turns out not to be a new construction technique for Golomb 
rulers, but rather equivalent to a classical one [30]. 

This result motivates the study of the number of fixed points of other Costas permutations. For example, setting 
f{i) = i and (3 = for some r such that (r, g — 1) = 1 in Theorem 3, and then setting a' = x, it follows that the 
number of fixed points of this G2 permutation equals the number of roots of a;'' + x = 1 in F(q), excepting x ~ \. 
Far more interesting, though, is the case of Wi permutations: setting f{i) = i in Theorem 1 it follows that the 
number of fixed points of a Wi permutation equals the number of roots i of 

i = OL-'^^" mod p4^ i = Col mod p, G = d""^ . (12) 

This is a transcendental equation over a finite field, and, to the best of our knowledge, there is no precedent of 
any relevant published work in the literature. The closest question considered is whether, for a given i, there exists 
a primitive root a such that i = a* modp, which is, in effect, the inverse problem, and has been answered in the 
affirmative (see [66, 69, 97] and references therein). 

Problem 18. Let g be a prime power and r be such that (r, g — 1) = 1. Determine the number of roots x of the 
equation + 2; = 1 in F((j). 

Problem 19. Let p be a prime, G S F*(|)), and ol a primitive root of F(p). Determine the number of roots 
i e [p — 1] of i = Ga* mod p. 

Some numerical results relevant to this problem can be found in [32]. Moreover, a stochastic model relating the 
solution of this problem to Lambert's function can be found in [31]. 

7.3 Forbidden positions 

Consider overlaying all known Costas arrays of order n. Are there any positions of the n x n square grid not covered 
by a dot? These positions, called forbidden positions, can simplify the enumeration of Costas arrays whenever they 
exist, as any permutation array featuring a dot in a forbidden position is automatically disqualified from being 
Costas. A search over the database proves that there is a single forbidden position in order 3 (namely the midpoint 
(2,2) of the grid), that there are no forbidden positions in orders 4 < n < 24, and that forbidden positions appear 
again in orders 25, 26, 27, and 29 [43, 44] (clearly, there can be no forbidden positions in orders of the form p — 1, 
p prime, due to the single periodicity of the W\ construction which applies there). 



14 



Unfortunately, forbidden positions have so far only been determined after the complete enumeration of a certain 
order, not before, with the exception of order 3. Though this order is trivially small, there is a brief and elegant 
argument that can be used, which may be generalizable to higher orders. Indeed, the first row of the difference 
triangle of a permutation / of order 3 contains only two entries, namely /(2) — /(I) and /(3) — /(2), which are 
equal iff 

/(2) - /(I) = /(3) - /(2) ^ 2/(2) = /(I) + /(3) ^ 3/(2) = /(I) + /(2) + /(3) = 6 ^ /(2) = 2. 

The key fact in this argument is that symmetric (polynomial) expressions over the values of / are the same for all 
permutations /: in this case, /(I) + /(2) + /(3) = 1 + 2 + 3 = 6. Can this technique be used for higher orders as 
well? 

Problem 20. Determine the forbidden positions for Costas arrays of a certain order without resorting to enumer- 
ation. 



7.4 Cross-correlation of G2 and Wi arrays 

Cross-correlation is one of the aspects of Costas arrays that has attracted considerable attention, in view of its 
importance in applications. More specifically, the optimal suppression of sidelobes exhibited by waveforms described 
by Costas arrays is, in practice, only half of the waveform's desirable behavior. As many RADAR/SONAR systems 
may be operating within the same geographical area and in the same frequency spectrum, provisions should be 
made to minimize cross- interference resulting from waveform collisions [50, 72]. The obvious solution is to select 
Costas arrays from within a family where pairwise cross-correlation of Costas arrays is uniformly bounded by as 
low as possible a bound. It would not be an exaggeration to say, then, that low cross-correlation is the "second 
half" of the definition of Costas arrays that find their way in practical RADAR/SONAR systems applications. 

Perhaps the first result relevant to the cross-correlation of Costas arrays was the demonstration by A. Frccdman 
and N. Lcvanon [5")] in 1985 that any two Costas arrays of the same order (trivially small orders excepted) must 
have a maximal cross-correlation of at least 2, and hence that ideal cross-correlation and ideal auto-correlation 
arc incompatible properties. The study of cross-correlations became more focused in later years, with the work 
by W. Chang and K. Scarbrough in 1989 [16], which demonstrated that there exist sets of Welch Costas arrays 
whose pairwise cross-correlation is ideal, provided that only a strip of the correlation surface around the origin is 
considered, and not the entire surface. Later, in 1994, S. Marie, I. Seskar, and E. Titlebaum [72] studied the cross- 
correlation of Welch Costas arrays more thoroughly, providing a table with the maximal observed cross-correlation 
between any two Welch Costas arrays of order p—l,p prime (effectively a first version of our Table ?? below), and 

p- 1 

showing that this cross-correlation is bounded above by — - — . The conference version of this work had appeared 

in ICASSP 1990 [93], where the authors had already observed that some primes corresponded to local minima in 
the table, and had identified them to be safe primes. 

An important part of the puzzle was still missing, though, namely cross-correlation results for Golomb Costas 
arrays. The subject had been considered by D. Drumheller and E. Titlebaum in 1991 [50], who suggested an upper 
bound that is, unfortunately, not always tight. Then, S. Rickard, in his Master's thesis in 1993 [77], extended 
the cross-correlation tables for Welch arrays of [93] and offered the corresponding results for Golomb arrays. He 
observed a surprising link between the Welch and Golomb results (given the two construction methods are so 
dissimilar), confirmed the special role of the safe primes for the Golomb results as well, and asked whether this link 
could be explained, though he did not offer any explanation. 

A unified presentation and formal justification of all aspects of cross-correlation of Costas arrays mentioned 
above was attempted in [41]. Though this publication went indeed considerably beyond its predecessors, it too did 
not succeed in explaining all observed results: many of them are listed in [41] as conjectures supported by empirical 
evidence and awaiting formal proof. 

Problem 21. Let p stand for a prime and q for a prime power. Define "^Wiip) = niax max 5"/^ f^(u,v) and 



pr 

^G-j (9) = niax max f {u, v), where the notation /i 7^ /2 denotes that /i and /2 must be produced by different 

{u,v) ifi^fi) ^ 

primitive roots. 

Prove that, with respect to '^Wi{p) and \I'g2(p), primes p can be classified into three groups: 
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p — 1 . . . p — 1 

• For non-safe primes p ^ 19 (such that — - — is not a prime, that is), ^vFi(p) = ^02(2') + 1 = — - — j where t 
is the smallest prime such that p = 1 mod (2i). 

p - 1 19-1 

• p = 19 is the only prime for which "^Wiip) = ^G2(p) ~ — ^ — = 6 = — - — , 3 being the smallest prime t 
such that 19 = 1 mod {2t). 

p-1 . 

• Primes p such that — - — is also a prime (safe primes, that is) correspond to local minima of both 'i'wi (p) 
and *G2(p)- 

Produce a formula for the values of these local minima. 

Furthermore, prove that, with respect to 5*02 (q), prime powers q can be classified into three groups: 

• For prime powers q ^ 16 such that neither ^-^ — nor (7 — 1 is a prime, 'i'wi (q) = 1, where t is either 

the smallest prime such that q = 1 mod (2t), if q is odd. or such that q = 1 mod t, if q is even. 

• q = 16 is the only prime power for which "ifG^il) = ^— ^ — = 5, where 3 is the smallest prime t such that 
16 = 1 mod t. 

• Prime powers q such that cither ^-^ — is prime (in which case, as can be easily verified, q = 3'" for some 

prime m) or q — 1 is prime (in which case q ~ 2™ for some prime m and g — 1 is a Mersenne prime) correspond 
to local minima of 4'g'2('?)- 

Produce a formula for the values of these local minima. 

Assuming p is a non-safe prime, show that "iiwiip) = max ^'^^^^(O, 0). Assuming q ^ 16,19 is a non-safe 

(/i?/2) 

prime power such that q — 1 is not prime, show that 'i!G^{q) ~ ^'^^ ^^(0, 0), where /{ and /2 are G2 permutations 
generated in F(g), such that, assuming the former is generated by primitive roots a and /3, the latter is generated 

1 

by and /3, where r is defined through the requirements that a) r = A h 1; b) (r, g — 1) = 1; c) A = 1 or 2; 

lU 

and d) w is the smallest possible (such an r is guaranteed to exit). 

Full details regarding the formulation of this detailed and complex conjecture can be found in [41]. The cross- 
correlation of Costas arrays within the same EC was considered in [35]. 

The consideration of cross-correlation suggests that not all Costas arrays may be equally suitable for RADAR/SONAR 
applications. Another criterion to consider is the maximal hop between consecutive dots/frequencies in a Costas 
array, as the farther apart two frequencies lie, the more the response of frequency hopping filter deviates from the 
ideal response when hopping between them [28]. 

7.5 A necessary property for G'2-arrays 

It was mentioned above that a necessary property of Wi arrays is their anti-refiective symmetry: every Wi array 
is anti-reflective, but there are some sporadic Costas arrays that are anti-reflective as well. A necessary property 
for G2 arrays generated in flnite flelds of odd characteristic was published in [24]: letting q be the size of the field, 
it follows that, for any G2 permutation /, 

f(p + fip -i) = t[f{p + 1) - f{p - 1)] mod (g - 1), where ^l = (13) 

Verification over the database suggest that this property may also be sufficient for G2 arrays, as no non-G'2 Costas 
array was found to satisfy it. 

Problem 22. Find a necessary property, similar in nature to anti-reflective symmetry and (13), for G2 arrays 
generated in finite fields of characteristic 2. 
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8 Problems related to variants and generalizations of Costas arrays 



Costas arrays are predominantly characterized by their optimal autocorrelation property, and as such they are 
only one out of the many different mathematical objects defined around this particular principle (each in its own 
distinct context) and considered in the literature. Examples include Sidon sets (also known as Golomb rulers) 
[30, 82], RADAR/SONAR sequences (also known as Golomb rectangles) [14, 56, 65, 73, 74, 82, 83, 99], Golomb 
rectangles [S3], honeycomb arrays [8, 10, 64], as well as arrays of dots where "half" of the Costas property hold, 
namely where all linear segments connecting pairs of dots either have distinct lengths or distinct slopes (but 
not necessarily both) [51, 68, 75, 98]. Further examples include generalizations of the Costas property in higher 
dimensions [27, 53] and in the continuum [26, 29, 47]. Some Costas arrays were also found found to yield Almost 
Perfect Nonlinear (APN) permutations [36, 45], which find applications in cryptography. An extensive study of 
signals built for "good correlation" (in various contexts) is presented in [()2]. 

8.1 Golomb rectangles 

Progressive relaxation of the constraints present in the definition of Costas arrays leads to new mathematical 
objects. For example, binary m x n arrays such that there be exactly one dot per column, and such that the range 
of their (horizontal only) autocorrelation consists only of the three values {n, 1, 0} are known as RADAR/SONAR 
arrays/sequences [56, 74, 82] and find applications in RADAR/SONAR systems. One step further, in extended 
RADAR sequences blank columns are also allowed [73]. 

The next natural step in this process is to abolish any restriction on the number and position of the dots in the 
array other than the distinct differences property itself. 

Definition 12. A Golomb rectangle [83] is a rectangular array of > 2 dots and blanks such that its auto- 
correlation range consists of exactly three values: {N, 1,0}. 

Such configurations also have found important application in cryptography, and specifically in the distribution 
of cryptographic keys over sensor networks [9]. Nevertheless, virtually nothing is known about the mathematical 
properties of these objects. 

Problem 23. Let C{m,n, N) stand for the number of m x n Golomb rectangles containing dots. Calculate 
C{m,n, N), and, in particular, for given m and n, find the maximal N for which C{m,n, N) > 0. Conversely, for 
a given N, find the smallest values of m and n for which C(m, n, N) > 0. 

The latter question has received considerable attention in the literature in connection with (optimal) RADAR/SONAR 
arrays [14, 65, 74, 99]: for an mxn RADAR/SONAR array (which has n dots, one per column), what is the maximal 
n for a given m (or effective bounds thereof)? 

8.2 Honeycomb arrays 

A honeycomb array [10, 64] is the equivalent of a Costas array on a hexagonal grid. Ordinary rectangular arrays 
are implicitly understood as conforming to a square grid: elements arc neatly arranged in rows and columns, and 
each element (except for those at the border of the array) has four natural neighbors, namely those lying above, 
below, to the left, and to the right, as if a square frame is drawn around each element and elements whose frames 
share an edge are defined to be neighbors. In a hexagonal grid, on the other hand, the frame around each element is 
a regular hexagon, so there are three natural directions associated with the grid, and six neighbors to each element 
(except for those at the border). The side of the regular hexagon can be assumed to be of length l/\/3, so that 
centers of neighboring hexagons are at distance 1 apart. 
The definition now is straightforward: 

Definition 13. Let r G N, and consider a hexagonal array of hexagonal cells, whose elements are dots and blanks, 
such that its side consist of r hexagons (and its diameter by 2r + 1 hexagons), and such that there be exactly one 
dot per row in each natural direction of the grid (that is, a total of 2r + 1 dots). This will be a honeycomb array 
iff either of the following equivalent conditions holds: 

• no two linear segments connecting pairs of dots (assumed to lie at the center of the cell they lie in) have both 
the same length and the same slope; or 
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• assuming two copies of the array are placed on top of each other, and one is shifted with respect to the other 
to any position (but not rotated, and so that overlapping cells overlap perfectly and not in part), the number 
of pairs of overlapping dots can only be 0, 1, or 2r + 1 (this is a restatement of the auto-correlation Definition 
2 in the hexagonal setting). 

Fortunately, there is a bijcctive correspondence between the hexagonal and the square grid [8, 10, 64], which 
allows the definition of honeycomb arrays as a subfamily of Costas arrays. Indeed, position a honeycomb array 
so that its diameter is horizontal, and align rows on top of the diameter along the right (to have a common start 
with the diameter), and rows below the diameter along the left (to have a common end with the diameter). In this 
arrangement, two of the three natural directions of the honeycomb array now correspond to rows and columns, 
while the third corresponds to diagonals along the bottom left-top right direction. Naturally, this is not a complete 
square array yet, as some square cells on the top left and bottom right corner are missing, but they can be added 
containing blanks. Thus, a honeycomb array of radius r has been mapped into a Costas array of order 2r + 1, and 
the mapping can be inverted. 

Definition 14. A honeycomb array is a Costas array with the extra property that every diagonal along the bottom 
left-top right direction contains exactly one dot. 

A major and surprising result is that no honeycomb array with 2r + 1 > 1289 dots exists [8] (or, equivalently, 
of radius r > 644), and, consequently, only finitely many honeycomb arrays exist. Specifically, only 12 (up to 
symmetry) arc known today, and it is conjectured that no other exists [10]. 

Problem 24. Enumerate all honeycomb arrays. 

Note that a Costas array configuration of non-attacking queens on the chessboard (see Problem 7) is a special 
case of a honeycomb array, where each diagonal along the perpendicular direction, namely bottom right-top left, 
also contains exactly one dot. Thus, there can be at most finitely many such Costas arrays as well. 

8.3 Relation between Costas arrays and Golomb rulers 

Golomb rulers owe their name to the studies of Prof. S. Golomb, who demonstrated an important application in 
graph labeling [60]. They have important applications in engineering, for example in radio-frequency allocation 
for avoiding third-order interference [2], in generating convolutional self-orthogonal codes [86], in the formation 
of optimal linear telescope arrays in radio-astronomy [7] etc., as well as an inherent mathematical interest. Even 
earlier, they had also been studied in the context of Fourier series [89]. 

A Golomb ruler (or Sidon set, or i32-sequence) is a collection of distinct integers such that all pairwise differences 
between them are also distinct. It can be visualized as a vector of dots and blanks, so that an element of the vector 
is a dot iff its position corresponds to one of the selected integers. Clearly, overlaying two copies of the vector, 
sliding one of the copies, and counting the number of pairs of overlapping dots leads to a count of either 0, 1, or of 
the total number of dots, if the two copies overlap perfectly. Hence, Golomb rulers are ID analogs of Costas arrays. 
Without loss of generality, it can be assumed that the Golomb ruler contains m integers, the smallest of which is 
and the largest n. 

Definition 15. Let m G N*, let / : [m] N be strictly increasing, and let /(I) = and n = f{m)- The range 
of / is a Sidon set (or a B2-sequence) iff all differences f{i) — f{j), < j < i < n arc distinct. In that case, the 
vector w : [ti -I- 1] — 1 — >■ {0, 1} such that v{f{i)) = 1, z G [m] and elsewhere is a Golomb ruler, n is the length of 
the Golomb ruler, and m its number of points. 

The two fundamental problems in the field are to determine a) the maximal possible m for a fixed n, and b) the 
minimal possible n for a fixed m. Golomb rulers satisfying either of these two extremes are called optimal (and, 
more specifically, optimally dense in the former case, and optimally short in the latter). 

Problem 25. Provide exact formulas for the length of optimally short Golomb rulers of a given number of points, 
and for the number of points of optimally dense Golomb rulers of a given length. 

Several inequalities involving m and n have been proposed for optimal Golomb rulers [21, 52, 70]: they essentially 
state that m w ^/n <^ n w m^. Furthermore, several construction techniques are available for Golomb rulers, which 
work for infinitely many (but not all) values of m, namely the Erdos-Turan [52], Ruzsa-Lindstrom [70, 71, 87], 
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Bosc-Chowla [11, 12], and Singer [90] constructions. A very comprehensive online resource about Golomb rulers is 
J.B. Shearer's webpage on Golomb rulers [88], where all optimal known optimal Golomb rulers are posted, while 
an overview of the theory of Golomb rulers and their construction techniques is provided in A. Dimitromanolakis's 
Diploma Thesis [21], and also in [30]. It should be mentioned that considerable effort has been put into the 
enumeration of optimal Golomb rulers, just like in Costas arrays (see, for example, [22, 85, 102]). 

Efforts have been made to relate Golomb rulers and Costas arrays directly, by converting one object into the 
other. A procedure was described in [46, 82] whereby any n x n Costas array (or a Golomb rectangle, more 
generally) can be converted into a Golomb ruler by adding at least n — 2 blank rows at the bottom and then 
stacking its columns in order one below the other. It was also determined empirically in [4(i] that for some Costas 
arrays less than n — 2 blank rows could be added with the same effect. A more elegant approach which involves 
tiling the integer plane using a binary array possessing distinct differences and then applying an unfolding operator 
is described in [54]. 

Problem 26. Convert efficiently a Costas array (or Golomb rectangle) into a Golomb ruler and vice versa. In 
particular, for a given Costas array (or a family thereof), determine the minimal number of blank rows that must 
be added at the bottom in order to form a Golomb ruler by stacking its columns in order one below the other. 

9 Conclusion 

After brief reports on recent research progress in various aspects of Costas arrays, a total of 26 open problems were 
proposed, and specifically: 

• nine core theoretical problems; 

• four problems related to the algebraic construction techniques; 

• three inverse problems; 

• six problems related to properties; and 

• four problems on variants and generalizations. 

This quite diverse selection, which naturally reflects the present author's experience and preferences, is intended 
to motivate researchers to consider working on the fascinating subject of Costas arrays. 
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